Usability: An introduction to and literature review of usability testing for educational resources in radiation oncology

Usability, or the ease with which something can be used, is a key aspect in ensuring end-users can achieve the best possible outcomes from a given educational resource. Ideally usability testing should take place iteratively throughout the design of the resource, and there are several approaches for undertaking usability testing described in the wider literature. Within radiation oncology education, the extent to which usability testing occurs remains unclear. This literature review aimed to assess current practice and provide a practical introduction to usability testing for educational resource design within radiation oncology.Two web databases were searched for articles describing planned or completed usability testing during the design of a radiation oncology educational resource. Fifteen studies were identified. Data was gathered describing the type of usability testing performed, the number of cycles of testing and the number of test subjects. Articles described design of educational resources for both patients and trainees, with the number of test subjects ranging from 8 to 18. Various testing methods were used, including questionnaires, think aloud studies and heuristic evaluation. Usability testing comprised a range of single cycle through to several rounds of testing.Through illustrative examples identified in the literature review, we demonstrate that usability testing is feasible and beneficial for educational resources varying in size and context. In doing so we hope to encourage radiation oncologists to incorporate usability testing into future educational resource design

Sharing and reuse in OER: experiences gained from open reusable learning objects in health

Normal 0 false false false MicrosoftInternetExplorer4 /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman"; mso-ansi-language:#0400; mso-fareast-language:#0400; mso-bidi-language:#0400;} Abstract:  The open educational resource (OER) movement has the potential to have a truly transformative effect on higher education, but in order to do so it must move into the mainstream and facilitate widespread participation in the sharing or creating of resources and in their reuse. To help in this process, experience can be gained from projects and initiatives which have acted as forerunners to this movement.  Here we present the experiences gained and lessons learnt from one such project based around the open sharing of reusable learning objects in health sciences education. In particular we share our experiences of reuse, its patterns, measurement, drivers, barriers, and tools designed to balance the pedagogical tensions between use and reuse. Like many in the OER movement we promote an emphasis on the role of community-building. We also argue that in order to produce materials that are worth sharing, value must firstly be placed on developing materials suitable for primary use, including robust evaluation and an alignment to real-world learning needs. Lastly, unlike the prevailing trends in OER we urge a consideration of quality assurance and outline the role that it can play in promoting sharing and reuse

Teaching tools in Evidence Based Practice: evaluation of reusable learning objects (RLOs) for learning about Meta-analysis

<p>Abstract</p> <p>Background</p> <p>All healthcare students are taught the principles of evidence based practice on their courses. The ability to understand the procedures used in systematically reviewing evidence reported in studies, such as meta-analysis, are an important element of evidence based practice. Meta-analysis is a difficult statistical concept for healthcare students to understand yet it is an important technique used in systematic reviews to pool data from studies to look at combined effectiveness of treatments. In other areas of the healthcare curricula, by supplementing lectures, workbooks and workshops with pedagogically designed, multimedia learning objects (known as reusable learning objects or RLOs) we have shown an improvement in students' perceived understanding in subjects they found difficult. In this study we describe the development and evaluation of two RLOs on meta-analysis. The RLOs supplement associated lectures and aim to improve students' understanding of meta-analysis in healthcare students.</p> <p>Methods</p> <p>Following a quality controlled design process two RLOs were developed and delivered to two cohorts of students, a Master in Public Health course and Postgraduate diploma in nursing course. Students' understanding of five key concepts of Meta-analysis were measured before and after a lecture and again after RLO use. RLOs were also evaluated for their educational value, learning support, media attributes and usability using closed and open questions.</p> <p>Results</p> <p>Students rated their understanding of meta-analysis as improved after a lecture and further improved after completing the RLOs (Wilcoxon paired test, p < 0.01 in all cases) Whilst the media components of the RLOs such as animations helped most students (86%) understand concepts including for example Forest plots, 93% of students rated usability and control as important to their learning. A small number of students stated they needed the support of a lecturer alongside the RLOs (7% 'Agreed' and 21% 'Neutral').</p> <p>Conclusions</p> <p>Meta-analysis RLOs that are openly accessible and unrestricted by usernames and passwords provide flexible support for students who find the process of meta-analysis difficult.</p

Co-producing a digital educational programme for registered children’s nurses to improve care of children and young people admitted with self-harm

Despite the increasing prevalence of hospital admissions for self-harm in children and young people (CYP), there is paucity of registered children’s nurse (rCN) training or involvement of children to improve care for this often stigmatized patient group. This article describes a participatory approach towards using co-production with CYP and rCN to develop a digital educational programme to improve nurses’ knowledge, attitudes and confidence in caring for CYP with self-harm injuries. A priority-setting workshop with rCNs was used to establish consensus of information needs. This was followed by an e-learning content development workshop undertaken with CYP whom had previously experienced hospital admissions for self-harm injuries. Findings from the nurse priority-setting workshop identified three educational priorities: (1) knowledge of self-harm, (2) effective communication and (3) risk management. The CYP subsequently developed these topic areas to ensure the contents and design of the e-learning resource had fidelity by reflecting the experiences of CYP and needs when cared for in hospital. This article illustrates that involving service users to co-develop educational materials is a feasible and important step in designing educational resources and ensures the content is relevant, appropriate and sensitive to both the recipient of care and those responsible for its delivery

Factors influencing COVID-19 health protective behaviours in Zambian university students with symptoms of low mood

BackgroundHealth protective behaviours are crucial in the prevention of the spread of COVID-19, particularly in university students who typically live and study in large groups. Depression and anxiety are common in students and can impact young people’s motivations to follow health advice. The study aims to assess the relationship between mental health and COVID-19 health-protective behaviours in Zambian university students with symptoms of low mood.MethodsThe study was a cross-sectional, online survey of Zambian university students. Participants were also invited to take part in a semi-structured interview to explore views about COVID-19 vaccination. Invitation emails were sent explaining the study aims and directed students who self-identified as having low mood in the past two weeks to an online survey. Measures included COVID-19 preventive behaviours, COVID-19-related self-efficacy, and Hospital and Anxiety Depression scale.ResultsA total of 620 students (n=308 female, n=306 male) participated in the study, with a mean participant age of 22.47±3.29 years (range 18–51). Students reported a mean protective behaviour score of 74.09/105 and 74% scored above the threshold for possible anxiety disorder. Three-way ANOVA showed lower COVID-19 protective behaviours in students with possible anxiety disorder (p=.024) and those with low self-efficacy (p<0.001). Only 168 (27%) said they would accept vaccination against COVID-19, with male students being twice as likely to be willing to accept COVID-19 vaccination (p<0.001). Of 50 students interviewed. 30 (60%) expressed fears about the vaccination and 16 (32%) were concerned about a lack of information. Only 8 (16%) participants expressed doubts about effectiveness.ConclusionStudents who self-identify as having symptoms of depression have high levels of anxiety. The results suggest that interventions to reduce anxiety and promote self-efficacy might enhance students’ COVID-19 protective behaviours. Qualitative data provided insight into the high rates of vaccine hesitancy in this population

Implementing internet-based cognitive behavioural therapy (moodgym) for African students with symptoms of low mood during the COVID-19 pandemic: a qualitative feasibilty study

Background: Online therapies have been shown to be effective in improving students’ mental health. They are cost-effective and therefore have particular advantages in low-income countries like Zambia where mental health resources are limited. This study aimed to explore the perceived impact of the COVID-19 pandemic and the feasibility of implementing an Internet-Based Cognitive Behavioural Therapy (iCBT) intervention (‘moodgym’) to improve resilience in vulnerable Zambian students. Methods: The study was a qualitative interview study. Participants identifying as having symptoms of low mood and completing a baseline, online survey (n = 620) had the option to volunteer for a semi-structured interview to explore views about their experience of the pandemic and the acceptability and perceived benefits and limitations of using moodgym. Results: A total of 50 students (n = 24 female, n = 26 male) participated in the study. One theme with 4 sub-themes, captured the severe emotional and social impact of the COVID-19 pandemic. A second, very strong theme, with 5 sub-themes, reflected the considerable negative effects of the pandemic on the students’ educational experience. This included the challenges of online learning. The third theme, with three subthemes, captured the benefits and acceptability of moodgym, particularly in terms of understanding the relationship between thoughts and feelings and improving academic performance. The fourth theme described the technical difficulties experienced by students in attempting to use moodgym. Conclusion: COVID-19 caused fear and impacted wellbeing in vulnerable students and severely impaired the quality of students’ educational experience. The findings suggest that moodgym might be a valuable support to students in a low-income country

Pharmacology education for nurse prescribing students – a lesson in reusable learning objects

<p>Abstract</p> <p>Background</p> <p>The shift away from a biological science to a social science model of nursing care has resulted in a reduction in pharmacology knowledge and understanding in pre-registration nursing students. This has a significant impact on nurse prescribing training where pharmacology is a critical component of the course from a patient safety perspective.</p> <p>Methods</p> <p>Reusable learning objects (RLOs) are electronic resources based on a single learning objective which use high quality graphics and audio to help engagement with the material and to facilitate learning. This study used questionnaire data from three successive cohorts of nurse prescribing students (n = 84) to evaluate the use of RLOs focussed around pharmacology concepts to promote the understanding of these concepts in students. A small number of students (n = 10) were followed up by telephone interview one year after qualification to gain further insight into students' perceptions of the value of RLOs as an educational tool.</p> <p>Results</p> <p>Students' perceptions of their own understanding of pharmacology concepts increased substantially following the introduction of RLOs to supplement the pharmacology component of the course. Student evaluation of the RLOs themselves was extremely positive with a number of students continuing to access these tools post-qualification.</p> <p>Conclusion</p> <p>The use of RLOs to support the pharmacology component of nurse prescribing courses successfully resulted in a perceived increase in pharmacology understanding, with some students directly implicating these educational tools in developing confidence in their own prescribing abilities.</p

Smartphone and medical related App use among medical students and junior doctors in the United Kingdom (UK): a regional survey

Background: Smartphone usage has spread to many settings including that of healthcare with numerous potential and realised benefits. The ability to download custom-built software applications (apps) has created a new wealth of clinical resources available to healthcare staff, providing evidence-based decisional tools to reduce medical errors. Previous literature has examined how smartphones can be utilised by both medical student and doctor populations, to enhance educational and workplace activities, with the potential to improve overall patient care. However, this literature has not examined smartphone acceptance and patterns of medical app usage within the student and junior doctor populations. Methods: An online survey of medical student and foundation level junior doctor cohorts was undertaken within one United Kingdom healthcare region. Participants were asked whether they owned a Smartphone and if they used apps on their Smartphones to support their education and practice activities. Frequency of use and type of app used was also investigated. Open response questions explored participants’ views on apps that were desired or recommended and the characteristics of apps that were useful. Results: 257 medical students and 131 junior doctors responded, equating to a response rate of 15.0% and 21.8% respectively. 79.0% (n=203/257) of medical students and 74.8% (n=98/131) of junior doctors owned a smartphone, with 56.6% (n=115/203) of students and 68.4% (n=67/98) of doctors owning an iPhone. The majority of students and doctors owned 1–5 medical related applications, with very few owning more than 10, and iPhone owners significantly more likely to own apps (Chi sq, p<0.001). Both populations showed similar trends of app usage of several times a day. Over 24hours apps were used for between 1–30 minutes for students and 1–20 minutes for doctors, students used disease diagnosis/management and drug reference apps, with doctors favouring clinical score/calculator apps. Conclusions: This study found a high level of smartphone ownership and usage among medical students and junior doctors. Both groups endorse the development of more apps to support their education and clinical practice

Can Healthcare Assistant Training (CHAT) improve the relational care of older people? Study protocol for a pilot cluster-randomised controlled trial

Background People aged 75 years and over account for one in four of all hospital admissions. There has been increasing recognition of problems in the care of older people, particularly in hospitals. Evidence suggests that older people judge the care they receive in terms of kindness, empathy, compassion, respectful communication and being seen as a person not just a patient. These are aspects of care to which we refer when we use the term 'relational care'. Healthcare assistants deliver an increasing proportion of direct care to older people, yet their training needs are often overlooked. Methods/design This study will determine the acceptability and feasibility of a cluster randomised controlled trial of 'Older People's Shoes' a two-day training intervention for healthcare assistants caring for older people in hospital. Within this pilot, two-arm, parallel, cluster randomised controlled trial, healthcare assistants within acute hospital wards are randomised to either the two-day training intervention or training as usual. Registered nurses deliver 'Older People's Shoes' over two days, approximately one week apart. It contains three components: experiential learning about ageing, exploration of older people's stories, and customer care. Outcomes will be measured at the level of patient (experience of emotional care and quality of life during their hospital stay), healthcare assistant (empathy and attitudes towards older people), and ward (quality of staff/patient interaction). Semi-structured interviews of a purposive sample of healthcare assistants receiving the intervention, and all trainers delivering the intervention, will be undertaken to gain insights into the experiences of both the intervention and the trial, and its perceived impact on practice. Trial registration The study was registered as an International Standard Randomised Contolled Trial (ISRCTN10385799) on 29 December 2014

A systematic review of interactive multimedia interventions to promote children's communication with health professionals: implications for communicating with overweight children

Background: Interactive multimedia is an emerging technology that is being used to facilitate interactions between patients and health professionals. The purpose of this review was to identify and evaluate the impact of multimedia interventions (MIs), delivered in the context of paediatric healthcare, in order to inform the development of a MI to promote the communication of dietetic messages with overweight preadolescent children. Of particular interest were the effects of these MIs on child engagement and participation in treatment, and the subsequent effect on health-related treatment outcomes. Methods: An extensive search of 12 bibliographic databases was conducted in April 2012. Studies were included if: one or more child-participant was 7 to 11 years-of-age; a MI was used to improve health-related behaviour; child-participants were diagnosed with a health condition and were receiving treatment for that condition at the time of the study. Data describing study characteristics and intervention effects on communication, satisfaction, knowledge acquisition, changes in self-efficacy, healthcare utilisation, and health outcomes were extracted and summarised using qualitative and quantitative methods. Results: A total of 14 controlled trials, published between 1997 and 2006 met the selection criteria. Several MIs had the capacity to facilitate engagement between the child and a clinician, but only one sought to utilise the MI to improve communication between the child and health professional. In spite of concerns over the quality of some studies and small study populations, MIs were found useful in educating children about their health, and they demonstrated potential to improve children’s health- related self-efficacy, which could make them more able partners in face-to-face communications with health professionals. Conclusions: The findings of this review suggest that MIs have the capacity to support preadolescent child-clinician communication, but further research in this field is needed. Particular attention should be given to designing appropriate MIs that are clinically relevant